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METHOD AND SYSTEM TO CREATE AND ACCESS AN OBJECT ON A 

COMPUTING SYSTEM 

FIELD OF THE INVENTION 

The present invention relates generally to a computing system and more particularly to 
a method and system to create and access an object on a computing system. 

BACKGROUND OF THE INVENTION 

Windows functions and applications, such as Device Manager, are not directly 
accessible from the desktop on a personal computer. Typically these applications are not 
directly accessible and may require the user to execute a series of steps to launch the 
application or function. For example, invoking the Device Manager program requires that the 
user, using the mouse, first right-clicks on "My Computer," then left-clicks on "Properties," 
then left-clicks on the "Hardware" flag, and, finally, left-clicks on the Device Manager button. 
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Screen capture tools do exist which can automate these keyboard and mouse events but 
these screen capture tools do not factor in other program activities which may occur, such as an 
unexpected pop-up of other program launches based on system scheduled events. 

There are tools available from records events. For example, Lotus provides a tool, 
referred to as ScreenCam, that records keystrokes, location-based mouse clicks, as well as the 
timings associated with these events. However, when these are utilized, some of the required 
tasks for recording the events are cumbersome and require several functions/actions on the part 
of the user in order to invoke/realize the desired result. 

Accordingly, what is needed is a system and method for easily invoking a function in a 
Windows environment while not requiring a significant amount of user interaction with the 
application. The program must be easily implemented in existing systems, must be cost- 
effective and easily utilized by a user. The present invention addresses such a need. 

SUMMARY OF THE INVENTION 

A system and method for creating and accessing an object in a computer system is 
disclosed. The computer system including an application and an operating system. The system 
and method comprises a plurality of application programming interfaces (APIs) calls in the 
operating system. The plurality of API calls being utilized to obtain and set state information 
related to the application. The system further comprises a record/playback application on the 
computer, the record/playback application being capable of generating and reading scripts 
based upon the API calls to record actions that represent the operations of the applications and 
to replay actions that represent operations of the application. 
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A system and method in accordance with the present invention utilizes accessibility 
screen reader technologies in order to create automated script files to launch program events. 
This can be accomplished by capturing the actions that the user's mouse and keyboard events 
create during the launching, or use of a program or application including, mouse clicks, 
commands, pull down menu selections, etc., by utilizing API calls to retrieve state information 
concerning the program application. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a system in accordance with the present invention. 

Figure 2 is a detailed diagram of the record and playback application in accordance 
with the present invention. 

Figure 3 is a flow chart which illustrates the record function in accordance with the 
present invention. 

Figure 4 is a flow chart which illustrates the playback function in accordance with the 
present invention. 

DETAILED DESCRIPTION 

The present invention relates generally to a computing system and more particularly to 
a method and system to create and access an object on a computing system. The following 
description is presented to enable one of ordinary skill in the art to make and use the invention 
and is provided in the context of a patent application and its requirements. Various 
modifications to the preferred embodiment and the generic principles and features described 
herein will be readily apparent to those skilled in the art. Thus, the present invention is not 
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intended to be limited to the embodiment shown but is to be accorded the widest scope 
consistent with the principles and features described herein. 

A system and method in accordance with the present invention utilizes existing 
application programming interfaces (APIs) within the Windows environment, such as the 
Accessibility APIs detailed in the accessibility SDK from Microsoft ®, to facilitate tracking 
user accesses to a given function. In case of the accessibility APIs, they are typically used for 
accessibility aids (specialized programs that help people with disabilities use computers more 
effectively). By leveraging the accessibility APIs, it is possible to track how a user accesses a 
given function and then to record the objects accessed to allow a script to be stored and 
replayed later. Once captured, the method and system in accordance with the present invention 
creates a new Windows object which is then placed on the desktop in the form of an icon. 
Additionally, using the standard icon properties, the user or application could assign a 
keystroke action to initiate the script. 

The user can then click on the icon at any time and initiate the launching of the 
Windows application or function, thereby making use of a scripting replay process which is 
much faster and easier to use than previous methods used to launch the Windows application 
or function. To describe the features of the present invention in more detail, refer now to the 
following description in conjunction with the accompanying figures. 

Figure 1 is a simple block diagram of a system 100 in accordance with the present 
invention. The system 100 comprises a record/playback application 104; an operating system 
102 coupled to the record/playback 104 application 104 which includes accessibility APIs 103; 
and an application 106 to be recorded. The record/playback application 100 is preferably 
implemented utilizing the accessibility API Suite by Microsoft. As is seen, state information 
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105 is the captured actions recorded by querying through the accessibility APIs from 
application 106. 

The system 100 in accordance with the present invention utilizes existing accessibility 
screen reader technologies in order to create automated script files to launch program events. 
This can be accomplished by capturing the actions that the user's mouse and keyboard events 
create during of launching of a program or application including, mouse clicks, commands, 
pull down menu selections, etc., by utilizing API calls to retrieve state information concerning 
the program application. 

In a preferred embodiment the system 100 is implemented by utilizing Windows 32-bit 
APIs, such as the Active Accessibility SDK provided by Microsoft, that report information 
about the object such as state (type of focus), name (file menu, pop-up, etc.), default action 
(open, close, edit, etc.) and Window handle. 

One of ordinary skill in the art would recognize that the APIs could be of any type that 
allow for the described functions. Once all actions and information necessary to launch a 
specific application or function have been captured by the record/playback application, this 
information is then bundled together into a unique script file or linked to a new icon object 
residing on the computer's desktop using the embodiment of this invention. The resulting icon 
or script file can then be invoked easily by the computer user by a one-button mouse click, or 
other similar user action, resulting in a process which is easily and quickly repeatable at any 
time. 

Figure 2 is a detailed diagram of the record/playback application 106 in accordance 
with the present invention. The record/playback application could be any of a variety of 
applications such as ScreenCam by Lotus. The record function 201 includes the Accessibility 
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APIs calls which are utililized to obtain the state information 202 from the application to be 
recorded. The record function of the record/playback application also includes a script 
generator 204 which interacts with element 202. The playback function 203 includes a script 
reader 205 which interacts with the APIs calls utilized to set the state information 206. As 
indicated previously, these APIs are already within the operating system and preferably are 
APIs related to the accessibility SDK program. 

To describe the operation of the system in record and playback mode, refer now to the 
following description in conjunction with the accompanying figures. Figure 3 is a flow chart 
which illustrates recording an application in accordance with the present invention. Referring 
to Figures 1 and 3 together, the record/playback application 104 is initiated, via step 302. The 
record/playback application 104 is assigned to the application 100 to be recorded, via step 304. 
Then the application 106 which is to be recorded is started, via step 306. The record/playback 
application 104 next records the actions that represent operation of the application 106, via step 
308. The actions are stored in the state information 105. The script information resulting 
from processing the state information 105, and the recording of these actions is then written to 
a file, via step 310. 

Figure 4 is a flow chart which illustrates the playback function in accordance with the 
present invention. Referring to Figures 1 and 4 together, first, the file related to the recorded 
application 106 is opened, via step 402. Next, script information is read into the file and 
actions are generated and stored in state information 105, via step 404. The recorded 
application 106 is then initiated based upon the file, via step 406. Finally, the actions are 
replayed that represent the operations of the application 106; these actions are read from state 
information 105 in the order in which they were recorded into 105, via step 408. 
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As before described, the system and method in accordance with the present invention 
captures or records the screen objects selected by the user as well as which mouse event or 
keystroke is invoked on each particular object. This eliminates the problem of another window 
interfering in the mouse events. On applications that have a delay associated with getting full 
options/being shown full options/choices being displayed from a drop-down menu, the 
method in accordance with the present invention has a wait period that pauses until the 
appropriate drop-down object appears, and then a mouse event will occur on it. This process 
increases the speed of repeating mouse events and keystrokes, as the event will occur right at 
the moment when the object is active, rather than having to capture hard-coded timing delays 
into the repeatable process. 

Although the present invention has been described in accordance with the 
embodiments shown, one of ordinary skill in the art will readily recognize that there could be 
variations to the embodiments and those variations would be within the spirit and scope of the 
present invention. Accordingly, many modifications may be made by one of ordinary skill in 
the art without departing from the spirit and scope of the appended claims. 
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